培训深度神经网络消耗了许多计算中心的计算资源份额。通常,采用蛮力的方法来获得高参数值。我们的目标是(1)通过启用对大型神经网络的二阶优化方法来增强此功能,以及(2)对特定任务进行性能优化器进行调查,以建议用户最适合他们的问题。我们介绍了一种新颖的二阶优化方法,该方法仅需要Hessian对向量的影响,并避免明确设置大型网络的Hessian的巨大成本。我们将提出的二阶方法与两个最先进的优化器进行了比较,这些方法在五个代表性的神经网络问题上进行了比较,包括回归和来自计算机视觉或变异自动编码器的非常深的网络。对于最大的设置,我们将优化器与HOROVOD有效平行,并将其应用于8 GPU NVIDIA P100(DGX-1)机器。
translated by 谷歌翻译
Vegetation Indices based on paired images of the visible color spectrum (VIS) and near infrared spectrum (NIR) have been widely used in remote sensing applications. These vegetation indices are extended for their application in autonomous driving in unstructured outdoor environments. In this domain we can combine traditional vegetation indices like the Normalized Difference Vegetation Index (NDVI) and Enhanced Vegetation Index (EVI) with Convolutional Neural Networks (CNNs) pre-trained on available VIS datasets. By laying a focus on learning calibrated CNN outputs, we can provide an approach to fuse known hand-crafted image features with CNN predictions for different domains as well. The method is evaluated on a VIS+NIR dataset of semantically annotated images in unstructured outdoor environments. The dataset is available at mucar3.de/iros2022-ppniv-tas-nir.
translated by 谷歌翻译